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Abstract : The  expressive  power  of  applicative  structures  is  investigated 

(particularly  APL  one-liners)  with  the  result  that  all  "practically"  com- 
putable functions  are  "one-liner"  expressible.  In  particular,  the  class 
of  functions  computable  by  one-liners  contains  the  elementary  functions. 
The  problem  of  reducing  the  Intermediate  storage  requirements  for 
evaluating  applicative  structures  is  shown  to  be  solvable  with  only  mod- 
est execution  time  degradation.  The  prospect  of  improving  these  results 
is  discussed  in  connection  with  an  outstanding  conjecture  concerning  a 
time-space  relationship. 


♦ 


Of  the  volumes  of  research  published  in  recent  years  on  programming 
language  design  and  compiler  construction  and  optimization,  most  of  it  has 


concentrated  on  the  "common  core"  shared  by  the  majority  of  the  several 
hundred  extant  programming  languages.  The  constituents  of  this  common 
core  are  a set  of  control  structures  (goto's,  while,  if-then-else,  etc.) 
and  a set  of  data  types  (real,  integer,  boolean,  array)  and  they  are 
often  referred  to  by  the  collective  term  Algol-like.  These  languages  have 
clearly  been  immensely  successful  both  for  their  pratical  utility  as  well 
as  for  the  large  body  of  theoretical  work  that  they  have  Inspired. 

We  belive,  however,  that  there  are  a few  languages  that  have  the 
virtue  of  being  sufficiently  different  from  the  Algol-like  languages  that 
they  raise  many  new  and  different  questions.  Such  languages  include,  for 
example,  SETL  [1],  MADCAP  [2],  and  APL  [3j.  We  plan  to  study  several 
questions  that  arise  in  the  applicative  structure  of  a language  like  APL. 

As  with  many  languages,  APL  has  both  advocates  and  adversaries  and 
since  the  latter  group  is  probably  larger  than  the  former  group,  we  feel 
compelled  to  comment  on  our  interest  in  APL  prior  to  proceeding  to  the 
technical  material.  Although  we  refuse  to  take  sides  in  the  discussion  as 
to  the  merits  of  APL,  we  address  the  criticism: 

Since  APL  is  "clearly"  the  "wrong  direction,"  any  results 
on  such  a language  are  uninteresting. 

There  are  several  arguments  against  this  view.  First,  there  is  already  a 
large  and  growing  APL  user  community  [4]  . Any  language  with  such  a large 
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Although  our  development  will  focus  on  a general  applicative 
structure,  wc  restrict  our  attention  here  to  APL  to  simplify 
the  exposition. 
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following  cannot  be  discussed  without  some  consideration  of  Its  special 
problems.  For  example,  it  seems  reasonable  to  study  the  efficient  imple- 
mentation of  this  language,  both  from  a practical  standpoint  as  well  as 
for  the  new  issues  raised  by  the  language.  Efficient  implementation  of 
APL  is  quite  different  from  efficient  implementation  of  Algol.  Secondly, 
topics  such  as  programming  style,  "structuring,"  use  of  eoto's.  verifica- 
tion, all  take  on  a different  emphasis  in  the  context  of  APL.  Thirdly, 
one  would 'hope'  tK$t  the  study  of  programming  languages  - as  basic  as  it 
is  to  computer  science  - is  broad  enough  to  include  language  studies  not 
squarely  in  the  "mainstream"  on  the  presumption  that  they  will  ultimately 
enhance  our  understanding  of  programming  in  general. 

The  first  question  which  should  be  asked  of  any  language  is 

Ql:  How  expressive  is  the  language?  • 


We  know  from  Turing  that  the  answer  here  - unless  qualified  - is  trivial: 
all  reasonable  progranmiing  languages  are  equal.  However,  in  an  applicative 
language  such  as  APL  one  can  make  Ql  more  precise:  how  expressive  is  an 

APL  one-liner,  i.e.,  an  APL  expression  that  calls  no  functions  and  uses  no 
branching  and  no  execute  operators.  It  is  this  question  that  we  propose  to 
study  first.  The  reasons  that  the  question  is  interesting  are  several: 


1. 


Those  who  believe  that  APL  forces  one  into  new  ways  of  solving 
problems  consider  a one-liner  as  the  basic  unit  of  APL.  Thus 
it  is  reasonable  to  consider  just  what  are  the  ultimate  limits 
to  such  expressions. 
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2.  The  answer,  which  demonstrates  that  such  expressions,  even  if 
greatly  restricted,  can  compute  a huge  class  of  functions,  is 


perhaps  surprising  to  some.  We  have  heard  many  conversations 
such  as : 


"Can  you  find  an  APL  one-liner  for 


We  now  can  answer  all  (well,  almost  all)  such  questions 
affirmatively. 


3.  While  our  results  demonstrate  the  great  expressive  power  of 
one-liners,  they  do  more  to  suggest  an  interesting  question 
about  the  power  of  applicative  languages  and  the  power  of 
more  classic  Algol-like  languages.  We  are  able,  we  believe, 
for  the  first  time  to  make  precise  the  intuitive  feeling  to 
many  that  APL  is  inherently  slower  than  Algol. 


We  now  will  state  precisely  our  main  result  that  addresses  Ql.  We 
assume  the  usualy  semantics  and  definitions  of  the  APL  operators  [5], 


Theorem  1 : Let  f : A^  -*•  A^  be  any  function  from  objects  of  rank  k to 


objects  of  rank  k (k*0)  that  is  computable  by  a random  access  computer  in 
time  t(n)  (n  = length  of  the  input  in  some  standard  encoding).  If  t(n)  < 2Cn 
(c  a constant),  then  there  is  a one-liner  E with  one  variable  v such  that 


for  all  v e A,  , 
k 


f (v)  is  equal  to  E. 


This  theorem  can  be  extended  immediately  to  include  even  larger  functions 
t(n)  and  functions  from  many  ranks  to  many  ranks.  Indeed,  if  f is  any 
elementary  function  [6]  there  is  an  E for  computing  it.  Moreover,  the 
one-liners  need  only  the  operators 
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+ addition 

subtraction 
= equality 

A v ~ logicals 

| residue 

p reshape 

/ reduction 

The  chief  difficulty  with  this  theorem  is  that  it  is  still  open  whether  or 
not  the  cost  of  evaluating  such  an  expression  as  E can  be  done  in  time 
t(n)  or  even,  say,  t (n).  By  time,  here,  we  mean  the  cost  of  evaluating  E 
by  any  of  the  standard  methods  of  evaluating  APL  [7].  A more  general 
question  is: 

can  one  add  a set  of  new  operators  to  APL  so  that 

Theorem  1 can  be  improved  to  where  E can  be  evaluated 
2 

in  time,  say,  t (n)? 

Clearly  one  must  restrict  the  operators  to  be  "reasonable"  in  that  they 
do  not  include,  for  example,  an  execute  command.  Perhaps  one  can  show 
that  no  applicative  language  can  be  as  powerful  in  this  sense  as  an  Algol- 
like  language. 

The  second  question  we  wish  to  study  is: 

Q2:  How  can  one  efficiently  implement  an  applicative 

language  such  as  APL? 

The  question  here  is  what  can  one  do  about  space;  in  particular,  how  can 
temporary  storage  be  reduced?  APL  and  other  applicative  languages  abound 
with  examples  of  statements  that  yield  small  answers  (i.e.,  scalars)  from 
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small  Inputs  (i.e.,  scalars)  and  yet  produce  during  their  executions  huge 
temporaries.  A commonly  cited  example  is  the  expression 

2=~l++/0=  \N 

which  decides  whether  or  not  the  integer  N i3  prime.  The  underscored 
portion  of  the  expression  produces  an  N * N array  although  the  input  and 
output  are  both  scalars.  Expressions  of  this  type  cannot  be  executed  on 
standard  implementations  not  because  they  would  run  too  long  but  rather 
because  they  use  too  much  space.  Thus,  Q2  is  really  the  following 
question: 

can  one  evaluate  APL  expressions  in  such  a way  that 
no  large  temporaries  are  created  and  so  that  the 
execution  tine  (over  the  usual  evaluation)  is  not 
increased  dramatically. 

The  answer  is  yes.  This  is,  perhaps,  surprising  to  some,  and  is  made  more 
interesting  when  it  is  realized  that  our  methods  appear  to  be  practical. 

We  will  now  briefly  sketch  our  method  of  implementation  of  an  arbitrary 
one-liner  E.  The  method  used  differs  from  the  method  of  [7j  and  [8]. 

Let  E be  a one-liner  with  one  free  variable  v (the  generalization  to  several 
is  easy) . Thus  E could  be 

+ / A + $ A V. 

We  then  show  how  to  inductively  construct  a module  M with  the  following 
property: 
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for  any  index  i into  the  position  of  the  answer  to  E 


I 


I 

M will  return  the  value;  M has  the  ability  to  request 
in  any  order  the  value  of  the  j^1  position  of  the  in- 
put V. 


The  key  requirement  here  is  that  we  enable  M to  access  the  elements  of  V 
in  any  order.  The  price  we  pay,  of  course,  is  that  M must  be  able  to  supply 
similar  Information,  i.e.,  M must  be  able  to  supply  the  iC^  position  to 
the  answer  of  E.  This  method  should  be  compared  with  the  stream  methods 
of  3.  The  insight  is  that  by  allowing  arbitrary  requests,  modules  such 
as  M can  be  inductively  constructed  for  any  APL  one-liner.  Indeed,  the 
only  temporary  storage  needed  in  any  such  module  is  just  the  storage  needed 
to  retain  control  information  (which  is  independent  of  size  of  inputs)  and 
the  storage  needed  to  keep  pointers  into  the  structures  being  handled. 

More  precisely, 


Theorem  2;  Let  Fbe  a one-liner  with  input  V.  Then  E can  be  evaluated 
in  space  bounded  by  the  space  required  for 

1.  storing  the  inputs  and  the  answer,  and 

2.  storing  a bounded  number  of  pointers  of  at  most  log  n bits 
where  no  temporary  structure  is  created  that  has  size  larger 
than  n. 

2 

Moreover,  the  time  to  evaluate  E by  this  method  is  at  most  0(t  ) for  any 

one-liner  where  t is  the  time  required  to  evaluate  E by  the  usual  methods 

and  is  at  most  0 ( t ) when  E has  no  occurrence  of  either  dyadic  * nor  scan. 

Theorem  2 suggests  an  interesting  reason  why  it  remains  open  whether 

2 

or  not  Theorem  1 can  be  improved  to  time  t (n) . Such  a simulation  would 


yield  a positive  result  to  the  conjecture  of  Cook  [9] 
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Is  O((log  n)  ) space  sufficient  to  recognize  all  languages 
recognizable  in  deterministic  polynomial  time? 


and  it  is  thus  unlikely.  Nevertheless  the  expressive  power  of  these  one- 
liners  is  extensive. 
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